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A MULTIVAMATE AilALYblS OF MTiaALLY -DmiVinD 
CATSJORIJ^ OF LMKCING DISORDm^ 

Barry L. Idallingsr, iStaven V/ Owen^ William KcCook, aiid Fiobert K. Gable 

, ' Univariity of Connecticut 

INmODUC tlOIl AICD BACKGROUm 
The literature ii;,di(rates there have been numerous problems in 
diapiosing the group of children with average or near-average intelligence 
but with learning diiabllitiiis, language and/or perceptual -mo tor dgficita. 
While many psychological instruments are allegedly ogpable of differential 
diagnosii, the Bender Visual^Motor Qestalt Test (Bender, I938) stami to 
be the most frequent ohoiee of dia^ostioiani^ This is especially the 
case when questions of organioity bx% raised (Sohulberg and Tolor, 1961)* 

A major source of difficulty in using the Bender-Gestalt for 
diffsrential diapiosls of children^ however ^ is the seleetion of criteria 
for claBsifying a youngster ^'learning disabled," , Research has shorn no 
single independent VOTiable to be consistently acouJi^ate in predicting 
learning disorderi (Blllingslea, 1953), However, a single studjr showtd 
that ehildren who were dia^osed as learning disabled on the basis of 
'^soft sipis" on piychoeducational evaluations 1 and placed in a Qlaesroom 
ispeoially desired to meet their individual nsids, manifested "hard 
signs" of CNS dysfimotiQn on subsequent neurological examination 
(Hertgig, 1969) • 
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In addition to the 3e nd er-Ge s tal t , the n e ohs 1 er In t e 1 1 i gena e 
Ooale for Chil_drtn (Wechslsrj 1945) is bIm frequantly usad for 
classification purposeB (Hartlage, 1966)^ Beck and Lam (1935) f 
investigating the effioacy of the WISC in predicting organieity in 
childran whose was lesi than SOp found that 31 of 42 previously 
diapiosad ^^organic" on the baaia of peychometrio data— wera subseguintly 
diapioeed orgMio on the basis of nsurological examination* Beok and 
Lam suggaBted that the probability of organieity increases considerably 
as the Wise IQ drops balow the 7O-8O range, 

Tolor and Sohulberg (1963) called for criteria which are more 
empirically determined for dia^ioitic ^oupingS| and which mora 
dietinotly differentiate among levels or Gattfories of behavior to be 
predicted* Ae Tatiuoka (I97I) has assertedp the need for application 
of multivariate taohniques to such olassifioation problems is prassing., 

Waintr (I966) inveitigatsd the WISO and the Bender-Qestalt as 

•I 

pradictore of minimal nam*ologioal impairment in 822 SS| 8-10 years of 
age. Using multiple re^assion analyseS| Weintr sought to differentiate 
between groups of subjects with v^ying da^ees of CMS deficits Several 
Bender-GeBtalt leortng eriteria ware foimd to predict dia^oses of 
neurological dysfunction (r^'^ZZ)^ Sipiificant predictors included inability 
to reproduce curves and mgles, wd ^oss motor or peroaptual distortions. 
Controlling for WISO Verbal Ift and 'race, total Bender sooreg sl^ifioantly 
disoaniinated nem^ological groups. A disoriminant function analyels was 
employed with oonflictlng results* Vihlte children were best classified 
by Bender acorei, while neurolofically impaired Black Si were best 
olasiifiid by WISG Performanoe Scale Ift. Weiner oalltd for further^ reeearch 
jising-multivariate techniques, into- the ^^derlying prooesses . or ; confft^^^ 
involved in the Bender^Qeg talt , . . - 



Burgiss arid his colleaguag (1570), using a multiplQ repression 
teahnique to predict organicity in neurological aiid psyohiatric OSf 
concluded that behavioral measwesy partioulia^ly visual -motor Indioes, 
can eignficantly differentiate these subjects. These researohsrB called 
for the use of multivariate prediction in future investigations of 
differential dia^oaiSt 

HcU'ing and Ridgway (1967) used a related procedura, principal com- 
pnnents analysis , to determine whether kinder§'artin ehildrenj who were 
identified by teachers as "potentially laarning disabledj" reQeived 
stand^dized tagt sGores indioatinf discernible common tralti^ Taaehere 
nominated 106 ohildpen as "high risk^' oandidateS| based upon defioite 
in areas coniidered basic to academic iuooess* These Ss were then 
administered the Stanf ord-Bina t and three WISC subtests,. Resulti in- 
dioated that, of the 3I predictor vwiables ooniidered, the most sigrifieant 
were language-related, accounting for 20'/ of the commonality in principal 
Gomponents analysis - Thv second principal component aoeounted for only 
ifa^ while the remaining components did not adequately aovoimt for a 
sipiificant percentage of the total variance, Haring and Eidgway 
fo\md that those Ss selected by teachers and later tested had few ccmmon 
identifiable learning pattarns, Tl:q.t is, there were no ii^iifloant 
distinctions between the standardised test performanoe of their Ss and a 
typical population of children. It was felt that differences in 
performanee apparently were "maBked" when data were treated ae a ^oup. 
None tUeless, these authors concluded that when given structured guidelines ^ 
kindergarten teachsrg can select children with potenti^ fuwre Isarning 
problems 3 
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Ackerman, Piters and I^lonan (l?7l) adminis tired the klBC to 82 
elementary age Ghildren diapidBid as "learning disabled" and to 34 
"normal^' controls* The exact criteria for th^ diagnosis ware not Gpecified 
hut the learning disahled ^oup included reading as well as other learning 
disorderly Using a Micriminant furictionj five seleoted vJIGC suhtesti' 
were found to he as reliable as ten in disoriminating controls from 
"learning disabled'^ Ss, Using these five subtests, a discriminant 
analyBie acourately identified ^6% of those Ss previously diagnosed 
as "disabled*" However, "severely disabled" readers could nat be\ 
distinpiished from "mildly disabled" raadersj or from adequate readers 
with other disabilltiess Iloreoveri a disoAninant analysis using ten 
*^ISO subtests could not separate (a) a group of neurologically-positive 
md "equivocal" learning-disabled Ss, from (b) a group of neurologioally-- 
negative and control Ssc 

A related approaoh was used in e^lier studies (Wheeler, et al , ^ 
1963a, 1963b) J in which discriminant functions were appliM to behavioral 
indices in predicting orgmicity in adult psychiatrio patients. It was 
found that^ in all aasesj the discriminant function mora accurately pre- 
dicted subjects' status thto did neOTological criteria* It was ccnoluded 
that the discriminant function has pragtioal value in predicting organic 
impairment from behavioral testis 

The need is great for applying such multivariate tectoilques to 
the classification of learning-dleabled school children. As Sa^er 
(1966) convincingly demonetratad, "clinical" prediction rarely betteri 
statistical (including multivariate) prediction, With such definitive 
evidence, it is surprising that man^r researchers, physiclang, and school 



psj^chologists oontinui to use exclusively clinioal judgments when 
dia^osing learning disorders* 

As the literature has indicatedj there is a need to determine the 
efficaoy with which hehavioral predictori can classify ehildren into 
a_ priori categories of leaning disorders 

The purpoee of this researohft theni aae to investigate two major 
objectives I 

I, To determine whether intelleotive and visual nnotor predictors 
oan olassifu elementary school children into rational , a priori 
categories of learning disorder, and 

II* To determine the accuracy and practical value of multiple 

discriminarit analysis in categorization of laarning disabilities* 

\ METHODS Mm/OR TBCHlJiatJES 

Data were analysed by meani of a multiple discriminant analysii 

technique, and sigitfioant discriminant functions were torived (Pinni 

1968) « The computer program used to compute the analyseB treated eaoh 

of the significance test (one for each predictor variable) on a given 

discriminant function as nonorthogonal. In so doing, It partialed out in 

a step-down fashion the effects of all preceding significance tests on 

the same dependent variable* Thui, the alpha level remained constant 

and the probability, of Ty^m II ai^rors did not insreaee witti each 

consecutive sipiificMce test for a given discriminant funotion* TOiese 

sigitficant discrminant functions were then applied slniultTOeouily to the 

sample in an effort to corop^e the empirically derived GlariificationB 

with the a priori dia^oses of judges ■ Krequenffis of hits ^d misses 

in classification of criterion ^oups were computed using the minimuiii 

chl gquare procedure described by Tatsuoka (iJTl)- Finally j the independ^t 

dimensions werei^edp and diaoriminant functioii centroids were plotted 

to indioate how the dimensioni separate the criterion groupi. Dimensions ; 

were then analysed in terms of the amount of oanoniaal vaj^ianos accounted for* 
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DATA SOUR CE " . 

SUSJBCTO . The sample for the study consisted of 225 elementary 
school Ghildren (6-7 years of age) in a suburbaii IJortheastern community 
in 1971 • All Ss had been nominated to attend "Pre^Primary^* (learninf 
disabilitieB) claesesi and each wae given an individiial psychological 
evaluatiDn* Eased upon the psyohological aaaessmant , children were 
clinically oategoriaad into one of five groupsi intellectual dificit, 
emotional uysfmiDtiQn, perceptual djfsfunctionp any combination of the 
prior p^oupings, and no dysfunction. Pour iohoQl psycholofists were used 
to make the ctoioal oategorigation^ Interrater agreement^ estimated 
by meani of Cronbaoh^i Qoeffioient alphai was ,86^ 

MEASURES^ Tvjenty three predictor variables were derived from the 
psyohclogioal evaluationB, and ai*e shown in Table 1. Theie included 
euoh standard meaeures as full scale anO subtest saQres from the HISC , 
Bender-GeBtalt subscores and discrepancy scores. In addition^ sex and 
age-in-months were included as predictor variables. 

Iniaf fTable'' 1 ^aBou t "heri 
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nESII.TS AND DISCISSIO N 

A one-way multivariate analTsls of variance (MNOVA) was ' 
employed with five criterion grnupe for the 23 original predictors. 
The P ratio for the mvitlvarlate test of the equality of mean vectors 
indicated that ^he five groups differed (F^j 766 ^'65 1 p<*000l). 

Table 1 eontalns the results of the discriminant analysis for the 
23 variablss. Raw and standardized Goefflcients are presented for 
the two significant derived f motions* The first dlsctlminant 
funetlon acQOunted for 78 percent of the canonical variation (chl square 
Cd.f^^a] ^ 35%%l p<.00n), while the second discriminant function 
accounted for '15 percent of the canonlcal^marlatlon (chl square QdL^f^-SQ 
^ 115.971 p<*0002). 

On the basis oi the F values and ths standardized coefficients in 
Table 1^ nine optimal predictors were selected for further analysis | 
five came from the flrtt function and eight from the second . Pour of 
these predictors were commoh to both functions^ Therefor e^ a seb of 
nine optimal p^ediotors was used for further analysis . The P ratio 
for the multivariate test dE equality of the mean vmtw a indicated 
that the five groups differed = ll*lCj p<,^000l). 

Table 2 contains the resulbs of the dr.sorlminant analyJis for these 
nine predictor variables. Raw and standardlied coemcients are 
presented for the two significant discriminant fimctions. For this 
predictor set cf nine Yariabn&' s/ the first discriminant fur^ctlon 
accounted for 82. percent crf^ the canonical variation (ehi square^ ^ ^ 
329 *57j p^^OOCa)j while the second dIsGrlralnant funotlon accoimted. fa» 
^ percent of the canonleal mriatlcn (chi square^ ^ _2^8435r P<^Oroi) , 

The most heavily weighted predictors in: the ftfet dlicriminant 
function reflected peroa^ ual-motor abilities (WISC Performance IQ and 
Bender Discre^ncy sQ^e). The second discriminant -function showed the V" 
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iTiDst heavily v/ei|b^ed vatlables to be associated with og'arall intellectual 
ability (IJISC Per for nance IQ and WISC Verbal 10). Group centroids on the 
two discrlnd^ant f unctions are presented in Table 3* A graDhlcal 
represent ation of the criterion groups in the bivarlate space is shovvn 
in Figure 1. 

It can be seen from Table I'that variables 8^ 13^ 14j 20^ and 23 
have the largest standardised coefficients on the first discriiidnant 
function, whlli variables 7, 8, 10, 14^ 20, 22, and 23 have the 
largest standardized coefficients on the second discriminant function* 
These variables seem to be of tvo broad types, one of general psychomota* 
ability (dlscrlmlnmt faction l) and tha other of overall Intelleotual 
ability (disiirliiiinant function II )* As such| they seem to fwm tm 
contlnuua or dimensions, along which extreme criterion groups may be 
discriminated* 

It should be poiinted out that the WISC Perfarmmee IQ was the most 
hea%dly weighted predictor variable on bobh discriminant functions* 
However, because of the very high relationship between Perforinancs IQ and 
the Wise Fun Scalb IQ ( r - ^fi^j Vleschler, 1949)^ it seems apprdprlate 
to assume that the second function actually defines the measurement 
apace as general intellectual flinctionlng. It is of interest to note 
that seven of the eight predictors ^ disorimdnant f-unctipn II are 
psychontotor in nature* This finding my reflect one or both aC two 
Interpretations r (a) the chili ren used in this research were all 
norriinoted to attend learning disabled classes, and the nominations my 
have been primarily based on f&ychomotor deficits | or (b) the judges 
making the classifications S^s into categories may have generally 
based their diagnoses more on informtlon; from psychomotor predictors than 
. on verbal data. .L 



Figure 1 lnr.iLi.ates that the perceptual continuum (discriminant 
function I) separates the group, of Ss having no ap^-srant disfunction fron 
those Ss considered to have any combination cf 3fi arning disorder. The 
dimension Gharacterlzed as overall intilleetual ability ( dlscriniinant 
function II), also shown in Plgure 1, seema to separate Ss diagnosed' 
as intelleotually deficient from those Ss considered to have a percept ual 
dysfunction. 
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MJCATIC u AL IMPLICATIONS OF^rmi Y 
ThiD siurv demcv.strated the feasiMlity £,4 efi^ciency of uoing 
tehavioral predictors to classify children into a priori e^ategorles of 
learning disorder* The practical value of such a finding rests in the 
aMlity to characterize a child's leaning problem early and as ao- 
ourataly as pOBSible^ ThiSp in turriy would hopefully lead to e^lier 
plac^nent of the child in an educational program suited to his particular 
nieds. 

This study, moreover , can be considered a validity investigation 
into the undtrlyi;%^ psyohoaofical dimtnsions at work when judgei make 
assigOTients to categories of learning disability* nius, the study 
was iMolved with construct validation, using discriminant analysis in 
the attempt to e^qplain Judgea*. behavior. As such* the study acoompldshed 
tv/o related goals i (l) Data reduotioni or the parsimonioui e^cplanation 
of olassifioation of young children into categories of learning disorder i 
and (2) oongtruct Talidationj or the asjamination of the underlying 
dimenaioni upon which judges assipied studints to such categories. 

Limitations of this study are being iuvestifated in current research 
in an attempt to anewar three crucial questionsi (l) What is the pradictiv 
acci^acy of the disoriminant functions when suipirlcally classifying Sb 
into oatBgories of lear^ning disorder? In other words, what are the 
percentages of hits and misjee of pr edi c t ton s with:. n aiid Mross categories? 
(2) lyould the same disorimiaan^^ functions or dimensions be obtained with 
a new sample of Ss? TOiat is, do the functions hold up mder cross- 
validation? Finally, (3) How would using a new sarnpli of judges but the' 
same functions affect the percentage of hits mid misses? 
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TABLE ■! 



" Mbo\ gHjnet. Cdeff's. 
S*«p Sown 

Variabl e ' F P Lees Than Haw ^ Std. Raw Std. 
V.'ISC: ~~ ' ~ " ■ 



X, 


Inform, 


3.80 


, .0053 


-.047 


-.135 


-,071 


•..204 


2. 


Corapr. 


6.18 


.0001 


.025 


,070 


-.0T3 


-.206 


3. 


Arith, 


5.13 . 


.0006 


-.015 


-.045 


-.003 


-.008 


4. ■ 


Simil. 


1.36 


.2507 


.011 


.052 


.036 


.163 




Tocab, 


2.29 


.0612 


.013 


.039 


-.023 


-.067 


6. 


Digitg 


3.41 


,0100 


-.025 


-.053 


.0:4 


.118 


7*; ^ 


2 

P. Comp, 


12.99 


,0001 


-.028 


-.068 


.130 


.311 




P. Arr.''»2 


5.92 


.0002 


-.129 


-.332 


.173 


.445 


9. 


Blocks 


9.92 


,0001 


-.082 


-.174 


-.043 


-.092 


10. 


Obj. As.^ 


3.11 


.0163. 


-.109 


-.2^5 


.144 


.336 


11. 


eoding2 


4.21 


.0027 


-.108 


-.297 


.167 


.41:3 


12. 


P.S. IQ 


1.40 


.2370 


.024, 


.168 


.006 


.050 


13. 


1 

Benders 
ISrror Seore 


26.51 


.0001 


-.274 


-.752 


-.087 


-.238 



14. 




3.39 


.0104 


.295 


.498 


.239 


.438 


15. 


Periever's, 


.37 


.8304 


.209 


.185 


.137 


.121 


16. 


Integration 


1.21 


.3086 


.155 


,208 


.081 


.109 


17. 


Age in mos. 


.91 


.4600 


-.001 


-.008 


-.015 


".097 


18. 


Sex, 


.65 


.6310 


-.201 


-•.099 


. -.166 


-.082 


19. 


Diitortions 
Bender ^ » ^ 


.24 


.9164 


.163 


,272 


.043 


■ .072 


20. 


Disorepanoy 


4.03 


.0036 


-.228 


-,509 


.239 


.537 


21. 


?-P Differ. 


1.23 


.3000 


-.007 


-,031 


-.029 


-.228 


22. 


Verbal IQ® 


.40 


. .8114 


,020 . 


.195 


.069 


.669 


23. 


Perf. 


1.00 


.4079 


.135 


1,16 


-.061 


-.523 




• 1 Optimal prsdiotora for Eisoriminant Punetion 


I . , 








2 Optimal prediotori for Disoriroinant Function II 







TAILE 2 




5t^^_F P lass Than Raw ^ ^d. Raw gtd. 



r. ooMp. 


19.22 


.0001 


-.027 


-.066 


-.fl}80 


-.431 


p. mt. 


10,10 


.0001 


.065 


.167 


-.215 


-.1555 


OBJ. AS. 


6.72 


.0001 


5044 


.103 


-.133 


-.357 


CODING 


3»24 


.0133 


.035 


.097 


-.200 


-.S51 
















Error 














Score 


32.61 


.0001 


.137. 


.375 


.053 


.146 


# ROTAT's. 


2.60 


.0375 


-.109 


-.185 


-.21:; 


-.364 


DISCRBP, 


5. 75 


.0002 


,185 




-.264 




Score 




.415 


-.590 



-287 -.06, -.6.6 
5.28 ■ .nnnc ... 



TABLE 3 

OROUP CaTRDIDS OCT Tm TOO LARQ^T DISCRIMIMM' PUUCTIOWS 



Intellectual Deficit 
Bnotional Dysfimction 
Perceptual I^sfunotion 
Any Com"bination 
No By sf unction 



Funstion i 
-7.69 
-8. 65 ' 

-7. 65 
-6-02 
-9.45 



Fmiotion 2 
-4.4^ 
-5.28 
=6.97 
-I). 96 
-6,15 . 
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CMTEOIDS OF DYSPUKCTION IN 3IV/iEIATE DIS0RIM::NAOT SI 'ACS 



DP I 



-10, -9. "8, 



-7,_ 



"6, - 5| -A, 



1 



IntelleotuRl defioit 



Bnutional 



iJo Efv"fDf'inction 



Ally L-'jiiiljinntidi-. 



-2, 



-1 

-2 . 

-4 DF 
-5 



3 PerDaptual 



-7 
^8 




